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Abstract 

Contraction theory is a powerful tool for proving asymptotic properties of nonlinear dynamical systems 
including convergence to an attractor and entrainment to a periodic excitation. We consider three generalizations 
of contraction with respect to a norm that allow contraction to take place after small transients in time and/or 
amplitude. These generalized contractive systems (GCSs) are useful for several reasons. First, we show that there 
exist simple and checkable conditions guaranteeing that a system is a GCS, and demonstrate their usefulness using 
several models from systems biology. Second, allowing small transients does not destroy the important asymptotic 
properties of contractive systems like convergence to a unique equilibrium point, if it exists, and entrainment to a 
periodic excitation. Third, in some cases as we change the parameters in a contractive system it becomes a GCS 
just before it looses contractivity with respect to a norm. In this respect, generalized contractivity is the analogue 
of marginal stability in Lyapunov stability theory. 


Index Terms 

Differential analysis, contraction, stability, entrainment, phase locking, systems biology. 


I. Introduction 

Differential analysis is based on studying the time evolution of the distanee between trajeetories 
emanating from different initial eonditions. A dynamieal system is ealled eontraetive if any two trajeetories 
eonverge to one other at an exponential rate. This implies many desirable properties ineluding eonvergenee 
to a unique attraetor (if it exists), and entrainment to periodie exeitations [|3, [El, iH. Contraetion theory 
proved to be a powerful tool for analyzing nonlinear dynamieal systems, with applications in control 
theory Q, observer design synchronization of coupled oscillators [|3, and more. Recent extensions 
include: the notion of partial contraction [|H1, analyzing networks of interacting agents using contraction 
theory [[^, [fTOl . a Lyapunov-like characterization of incremental stability [fTTl . and a LaSalle-type principle 
for contractive systems IfT^ . There is also a growing interest in design techniques providing controllers 
that render control systems contractive or incrementally stable; see, e.g. lfT3l and the references therein, 
and also the incremental ISS condition in lfT4l ). 

A contractive system with added diffusion terms or random noise still satisfies certain asymptotic 
properties IITSlI . [[T6ll . In this respect, contraction is a robust property. 

In this paper, we introduce three forms of generalized contractive systems (GCSs). These are motivated 
by requiring contraction with respect to a norm to take place only after arbitrarily small transients in time 
and/or amplitude. Indeed, contraction is usually used to prove asymptotic properties, and thus allowing 
(arbitrarily small) transients seems reasonable. In some cases as we change the parameters in a contractive 
system it becomes a GCS just before it looses contractivity. In this respect, a GCS is the analogue of 
marginal stability in Lyapunov stability theory. We provide several sufficient conditions for a system to be 
a GCS. These conditions are checkable, and we demonstrate their usefulness using examples of systems 
that are not contractive with respect to any norm, yet are GCSs. 

We begin with a brief review of some ideas from contraction theory. For more details, including the 
historic development of contraction theory, and the relation to other notions, see e.g. lITTII . IfTSl . |[T9l . 
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Engineering-Systems and the Sagol School of Neuroscience, Tel Aviv University, Israel 69978; EDS (eduardo.sontag@gmail.com) is with the 
Dept, of Mathematics and the Center for Quantitative Biology, Rutgers University, Piscataway, NJ 08854, USA; TT (tamirtul@post.tau.ac.il) 
is with the Dept, of Biomedical Engineering and the Sagol School of Neuroscience, Tel-Aviv University, Tel-Aviv 69978, Israel. EDS’s work 
is supported in part by grants NIH 1R01GM100473, AFOSR FA9550-14-1-0060, and ONR N00014-13-1-0074. The research of MM and 
TT is partly supported by a research grant from the Israeli Ministry of Science, Technology and Space. 
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Consider the time-varying system 


( 1 ) 


with the state x evolving on a positively invariant eonvex set C We assume that f{t,x) is 
differentiable with respeet to x, and that both f{t,x) and J{t,x) := |^(f,x) are continuous in (f,x). 
Let x{t,to,xo) denote the solution of ([U) at time t > to with x{to) = xq (for the sake of simplicity, we 
assume from here on that x{t,to,Xo) exists and is unique for all t > to > 0 and all Xq G fl). 

We say that ([T]) is contractive on with respect to a norm | ■ | : R"^ ^ R+ if there exists c > 0 such 
that 

|x(f 2 ,fi,a) - x{t 2 ,ti,h)\ < exp(-(t 2 - ti)c)|a - h\ (2) 

for all ^2 > fi > 0 and all a,b G In other words, any two trajectories contract to one another 
at an exponential rate. This implies in particular that the initial condition is “quickly forgotten”. Note 
that Ref. El provides a more general and intrinsic definition, where contraction is with respect to a 
time- and state-dependent metric M{t, x) (see also [l20l for a general treatment of contraction on a 
Riemannian manifold). Some of the results below may be stated using this more general framework. But, 
for a given dynamical system finding such a metric may be difficult. Another extension of contraction is 
incremental stability ifTTl . Our approach is based on the fact that there exists a simple sufficient condition 
guaranteeing Q, so generalizing Q appropriately leads to checkable sufficient conditions for a system to 
be a GCS. Another advantage of our approach is that a GCS retains the important property of entrainment 
to periodic signals. 

Recall that a vector norm | ■ | : R"^ ^ R_|_ induces a matrix measure /r : R"^" —)■ R defined by 
/r(A) := lim^o 7(11-^ + I ~ I); where 11 ■ 11 : R"^"' —)■ R+ is the matrix norm induced by | ■ |. A standard 
approach for proving @ is based on bounding some matrix measure of the Jacobian J. Indeed, it is 
well-known (see, e.g. Q) that if there exist a vector norm | ■ | and c > 0 such that the induced matrix 
measure /i : R"^" ^ R satisfies 

/i(J(f,x)) <-c, (3) 

for all ^2 > > 0 and all X G then ([21) holds. (This is in fact a particular case of using a Lyapunov- 

Finsler function to prove contraction lU^ .l 

It is well-known ^1\[ Ch. 3] that the matrix measure induced by the Li vector norm is 

/ii(A) = max{ci(A),... ,Cn(A)}, (4) 

where 

Cj{A) := Ajj -|- ( 5 ) 

l<i<n 

i.e., the sum of the entries in column j of A, with non diagonal elements replaced by their absolute values. 
The matrix measure induced by the Loo norm is 

tiooiA) = max{di{A),... ,dn{A)}, (6) 

where 

dj{A) := Ajj -|- \Aji\, (7) 

l<i<n 

i.e., the sum of the entries in row j of A, with non diagonal elements replaced by their absolute values. 

Often it is useful to work with scaled norms. Let | ■ |* be some vector norm, and let /i* : —)■ R 

denote its induced matrix measure. If P G is an invertible matrix, and | ■ : R"^ —>■ R_|_ is the 

vector norm defined by \z\^^p := \Pz\^, then the induced matrix measure is jji^^p{A) = fi^{PAP~^). 

One important implication of contraction is entrainment to a periodic excitation. Recall that / : R+ x 
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f2 —)■ is called T -periodic if 


f{t,x) = f{t + T,x) 

for all t > 0 and all a; G fl. Note that for the system x{t) = f{u{t),x{t)), with u an input (or excitation) 
function, / will be T periodic if u is a T-periodic function. It is well-known [|2l|, [|3|| that if ([B is contractive 
and / is T-periodic then for any > 0 there exists a unique periodic solution a : [fi, cxd) —)■ of ([B, of 
period T, and every trajectory converges to a. Entrainment is important in various applications ranging 
from biological systems [l22ll . (Si to the stability of a power grid [l23ll . Note that for the particular case 
where / is time-invariant, this implies that if contains an equilibrium point e then it is unique and all 
trajectories converge to e. 

The remainder of this paper is organized as follows. Section |n] presents three generalizations of Q. 
Section Hn] details sufficient conditions for their existence, and describes their implications. The proofs of 
all the results are detailed in Section |Vl 

II. Definitions of contraction after small transients 

We begin by defining three generalizations of @. 

Definition 1 The time-varying system ([B is said to be: 

• contractive after a small overshoot and short transient (SOST) on D w.r.t. a norm | ■ | : R"^ —)■ R+ if 
for each c > 0 and each r > 0 there exists £ = f (r, c) > 0 such that 

\x{t 2 -f a) - x{t 2 -\-T,ti,b)\ < (1 -f c) exp(-(f 2 - ^i)^)|a - b\ (8) 

for all t 2 >ti>t] and all a,b ^ fl. 

• contractive after a small overshoot (SO) on Tl w.r.t. a norm | ■ | : R” —)■ R+ if for each £ > 0 there 
exists i = i(e) > 0 such that 

\x(t 2 ,ti, a) - x(t 2 , ti,b)\ < (1 -f c) exp(-(f 2 - ^i)^)|a - b\ (9) 

for all t 2 > ti > 0 and all a,b ^ Q. 

• contractive after a short transient (ST) on w.r.t. a norm | ■ | : R"' R+ if for each r > 0 there 
exists i = ('(r) > 0 such that 

\x(t 2 + r,fi, a) - x(t 2 + r, fi, b)\ < exp(-(f 2 - ti)i)\a - b\ (10) 

for all t 2 > ti > 0 and all a,b & Q. 

The definition of SOST is motivated by requiring contraction at an exponential rate, but only after an 
(arbitrarily small) time r, and with an (arbitrarily small) overshoot (l-t-c). However, as we will see below 
when the convergence rate i may depend on c a somewhat richer behavior may occur. The definition 
of SO is similar to that of SOST, yet now the convergence rate i depends only on e, and there is no time 
transient r (i.e., r = 0). In other words, SO is a uniform (in r) version of SOST. The third definition, ST, 
allows the contraction to “kick in” only after a time transient of length r. 

It is clear that every contractive system is SOST, SO, and ST. Thus, all these notions are generalizations 
of contraction. Also, both SO and ST imply SOST and, as we will see below, under a mild technical 
condition on © SO and SOST are equivalent. Figured on p. O summarizes the relations between these 
GCSs (as well as other notions defined below). 

The motivation for these definitions stems from the fact that important applications of contraction are 
in proving asymptotic properties. For example, proving that an equilibrium point is globally attracting or 
that the state-variables entrain to a periodic excitation. These properties describe what happens as f —)• cx), 
and so it seems natural to generalize contraction in a way that allows initial transients in time and/or 
amplitude. 

The next simple example demonstrates a system that does not satisfy Q, but is a GCS. 
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Example 1 Consider the scalar time-varying system 

x(t) = —a{t)x(t), (11) 

with the state x evolving on := [— 1 , 1 ], and a : M+ —)■ M+ is a class Kfunction (i.e. a is continuous and 
strictly increasing, with a(0) = 0). It is straightforward to show that this system does not satisfy @ w.r.t. 
any norm (note that the Jacobian J(t) = —a(t) satisfies J(0) = 0), yet it is ST, with £(r) = a(r) > 0, 
for any given r > 0 . 

The next section presents our main results. The proofs are placed in Section |Vl 

III. Main Results 

The next three subsections study the three forms of GCSs defined above. 

A. contractive after a small overshoot and short transient 

Just like contraction, SOST implies entrainment to a periodic excitation. To show this, assume that the 
vector field / in ([T]) is T periodic. Pick to > 0. Define m : D ^ D by m{a) := x{T + to, to, a). In other 
words, m maps a to the solution of O at time T + to for the initial condition xfo) = a. Then m is 
continuous and maps the convex and compact set D to itself, so by the Brouwer fixed point theorem (see, 
e-g- [ES Ch. 6 ]) there exists ( ^ ^ such that m{() = (, i.e. x{T + to,to,C) = (. This implies that ([T]) 
admits a periodic solution 7 : [to, 00) —)■ with period T. Assuming that the system is also SOST, 
pick T,e > 0. Then there exists i = i{T, e) > 0 such that 

\x{t-to + T,to,a) - x{t-to + T,to,C)\ < (1 + £) exp(-(f - fo)^)|a - Cl, 

for all a G O and all t > to. Taking f —)■ cx) implies that every solution converges to 7. In particular, there 
cannot be two distinct periodic solutions. Thus, we proved the following. 

Proposition 1 Suppose that the time-varying system ([T]), with state x evolving on a compact and convex 
state-space O C M”, is SOST, and that the vector field f is T-periodic. Then for any to > 0 it admits a 
unique periodic solution 7 : [to, 00) —)■ O with period T, and x(t, to, a) converges to 7 for any a E Q. 

Since both SO and ST imply SOST, Proposition [T| holds for all three forms of GCSs. 

Our next goal is to derive a sufficient condition for SOST. One may naturally expect that if ([T]) is 
contractive w.r.t. a set of norms | ■ with, say ( G (0,p], p > 0, and that lim^^.o | • lc = I ' I then ([T]) 
is a GCS w.r.t. the norm | ■ |. In fact, this can be further generalized by requiring ([T]) to be contractive 
w.r.t. I • 1^ only on suitable subset of the state-space. This leads to the following definition. 

Definition 2 System ([T]) is said to be nested contractive (NC) on O with respect to a norm \ ■ \ if there exist 
convex sets C O, and norms | ■ —)■ M+, where C G (0,1/2], such that the following conditions 

hold. 

(a) U^g(o,i/ 2 ] 0 (^ = O, and 

— ^C 2 , Cl ^ (2- (12) 

(b) For every r > 0 there exists ( = ((r) E (0,1/2], with C(t) —?• 0 ai r —?• 0, such that for every a E fl 
and every ti > 0 

x(t,ti,a) E fl(, for all t > ti + T, (13) 

and O is contractive on with respect to | ■ |^. 

(c) The norms \ ■ |<^ converge to \ -\ as C, ^ D, i.e., for every C > 0 there exists s = s(() > 0, with s(() —)■ 0 
aj' C 0 , that 

(1 - s)|i/| < |i/|^ < (1 + s)|i/|, for all y eVL. 
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Eq. (fT3l) means that after an arbitrarily short time every trajeetory enters and remains in a subset 
of the state spaee on whieh we have eontraetion with respeet to | ■ |^. We ean now state the main result 
in this subseetion. 

Theorem 1 If the system ([T]) is NC w.r.t. the norm \ ■ \ then it is SOST w.r.t. the norm | ■ |. 

The next example demonstrates Theorem [U It also shows that as we change the parameters in a 
contractive system, it may become a GCS when it hits the “verge” of contraction (as defined in Q). This 
is reminiscent of an asymptotically stable system that becomes marginally stable as it looses stability. 

Example 2 Consider the system 

Xl = g{Xn) - ttlXi, 

X2 — Xi — <y.2X2-i 
X3 = X2 — a^xs, 


Xn 


Xn—1 OinXni 


(14) 


where a* > 0, and 




I + u 
k + u 


with k > 1. 


As explained in yl25l Ch. 4] this may model a simple biochemical feedback control circuit for protein 
synthesis in the cell. The Xts represent concentrations of various macro-molecules in the cell and therefore 
must be non-negative. It is straightforward to verify that a;(0) G implies that x(t) G for all t > 0. 
Let a := YYi=i and for e > 0 let 


De := diag ^1, ai - e, (ai - e){a 2 - e),..., J^(ai - . 

We show in Section 0 that if 

k — 1 < ak'^ (15) 

then (fT4l) is contractive on w.r.t. the scaled norm \ ■ \i^De faf all e > 0 sufficiently small. Ifk — 1 = ak'^ 
then (fT4l) does not satisfy dH), w.r.t. any norm, on M”, yet it is SOST on M" w.r.t. the norm \ ■ 

Note that for all x G M", 

Thus (fTSl) implies that the system satisfies dH) If cmd only if the “total dissipation ” a is strictly larger 
than g'ff). 

Using the fact that g{u) < 1 for all u >0 it is straightforward to show that the set 


Vtr := r([0, X [0, (^ 102 ) x • • • x [0, a ^]) 


is an invariant set of the dynamics for all r > 1. Thus, m, with k — 1 < ak"^, admits a unique equilibrium 
point e G fli and 

lim x{t, a) = e, for all a G M!). 

t—>-oo 

This property also follows from a more general result ^25\ Prop. 4.2.1] that is proved using the theory 
of irreducible cooperative dynamical systems. Yet the contraction approach leads to new insights. For 
example, it implies that the distance between trajectories can only decrease, and can also be used to 
prove entrainment to suitable generalizations of (fT4l) that include periodically-varying inputs. 
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Cells often respond to external stimulus by modifieation of proteins. One meehanism for this is 
phosphorelay (also ealled phosphotransfer) in whieh a phosphate group is transferred through a serial 
ehain of proteins from an initial histidine kinase (HK) down to a final response regulator (RR). The next 
example uses Theorem [1] to analyze a model for phosphorelay from lf26l . 

Example 3 Consider the system 

= {pi - xi)c - 'nixi{p2 - X 2 ), 

X2 = VlXl{p2 - X2) - ri2X2{Pz - X3), 


Xn—1 Pn—2Xn—2{Pn—l Xn—l) Pn—lXn—l{Pn 

Xn = r]n-lXn-l{Pn “ Xn) - PnXn, (IV) 

where rji^pi > 0, and c : [fi, 00) R_,_. In the context of phosphorelay c{t) is the strength at time t 

of the stimulus activating the HK, Xi{t) is the concentration of the phosphorylated form of the protein at 
the ith layer at time t, and pi denotes the total protein concentration at that layer. Note that rjnXn is the 
flow of the phosphate group to an external receptor molecule. 

In the particular case where Pi = 1 for all i (fTV]) becomes the ribosome flow model (RFM) fT7\I . This 
is the mean-field approximation of an important model from non-equilibrium statistical physics called 
the totally asymmetrie simple exclusion process (TASEP) l[28\l . In the RFM, x* G [0,1] is the normalized 
occupancy at site i, where Xi = D [Xi = 1] means that site i is completely free [full], and rji is the 
capacity of the link that connects site i to site i + 1. This has been used to model mRNA translation, 
where every site corresponds to a group of codons on the mRNA strand, xflt) is the normalized occupancy 
of ribosomes at site i at time t, c{f) is the initiation rate at time t, and rji is the elongation rate from 
site i to site f + 1. 

Our original motivation for generalizing (O was to prove entrainment in the RFM /22]/- For more 
results on the RFM, see / f29l/ . /U/l/ . / Il2l/ . / [33l/ . 

Assume that there exists rjo > 0 such that c(t) > pofor all t > ti. Let := [0,pi] x • • • x [0,p„] denote 
the state-space of CT]). Then, as shown in Section^ (fTVl) does not satisfy dH), w.r.t. any norm, on Ll, yet 
it is SOST on w.r.t. the Li norm. 

Considering Theorem [U in the special case where all the sets in Definition [2] are equal to D yields 
the following result. 

Corollary 1 Suppose that Q is contractive on w.r.t. a set of norms | • |^, ^ G (0,1/2], and that 
condition (jcj) in Definition^ holds. Then ([T]) is SOST on Q, w.r.t. | ■ |. 

Corollary [T] may be useful in cases where some matrix measure of the Jacobian J of ([U) turns out to be 
non positive on Ll, but not strictly negative, suggesting that the system is “on the verge” of satisfying ([2l). 
The next result demonstrates this for the time-invariant system 

x = f{x), (18) 

and the particular case of the matrix measure pi : —)■ M induced by the Li norm. Recall that this is 

given by dH) with the CjS defined in dS]). 

Proposition 2 Consider the Jacobian J(-) : ^ of the time-invariant system dTSl) . Suppose that Ft 

is compact and that the set {1,... ,n} can be divided into two non-empty disjoint sets Sq and such 
that the following properties hold for all x G fl.' 

1) for any k G Sq, cflJi^x)) < 0; 

2) for any j G S-, Cj{J{x)) < 0; 
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3) for any i E Sq there exists an index z = z{i) E such that Jzfx) > 0. 

Then (fT^ is SOST on w.r.t. the Li norm. 

The proof of Proposition [2] is based on the following idea. By eompaetness of Vt, there exists 5 > 0 
sueh that 

Cj{J{x)) < — 6 , for all j E S', and all x E Q. (19) 

The eonditions stated in the proposition imply that there exists a diagonal matrix P sueh that Ck{PJP' 

0 for all k E Sq. Furthermore, there exists sueh a P with diagonal entries arbitrarily close to 1, 
so Cj{PJP~^) < —6/2 for all j E S_. Thus, ^i{PJP~^) < 0. Now Corollary [T| implies SOST. Note that 
this implies that the eompaetness assumption may be dropped if for example it is known that (fT9l) holds. 


Example 4 Consider the system: 


X = — 6x + kiy — k 2 {eT — y)x, 
y = -kiy + k 2 {eT - y)x, 


( 20 ) 


where 6, ki,k 2 ,eT > 0, and O := [0, cxd) x [0, ct]. This is a basic model for a transcriptional module that 
is ubiquitous in both biology and synthetic biology (see, e.g., /f3?l/ . 0]/ ). Here x(f) is the concentration 
at time t of a transcriptional factor X that regulates a downstream transcriptional module by binding 
to a promoter with concentration e{t) yielding a protein-promoter complex Y with concentration y{t). 
The binding reaction is reversible with binding and dissociation rates ^2 tind ki, respectively. The linear 
degradation rate of X is 5, and as the promoter is not subject to decay, its total concentration, ct, is 

-6 - k2{eT -y) ki + k2X 
k2{eT - y) -ki - k2X_ 

the properties in Prop. |2] hold with S- = {1} and Sq = {2}. Indeed, J 12 = ki + k 2 X > ki > 0 for 
all \x y''^ E O. Thus, (l20l) is SOST on O w.r.t. the Li norm. Note that Ref. /I2]/ showed that (l20l) 
contractive w.r.t. a certain weighted Li norm. Here we showed SOST w.r.t. the (unweighted) Li norm. 


conserved, so e(t) = ct — yif)- The Jacobian of 


is J = 


and all 


IS 


Example 5 A more general example studied in ^ is where the transcription factor regulates several 
independent downstream transcriptional modules. This leads to the following model: 

X = - 6 xP kiiyi - /C2l(eT,l - yi)x + ^122/2 - /C22(er,2 - y2)x H-h kinPn - (^2n(er,n - yn)x, 

yi = - kuyi + k2i{eT,i - yi)x, 


ijn k^ndn T k2ni,^T,n yn)X, (21) 

where n is the number of regulated modules. The state-space is O = [0, cxd) x [0, e^^i] x • • • x [0, eT,n]- 
The Jacobian of (l2TI) is 



- Er=i ^2i(er,i - Vi) 

kll + k2lX 

kl2 + k22X 

kln-l + k 2 n-lX 

kin + k 2 nX 


k2l{^T,l — Hi) 

-ku - k2iX 

0 

0 

0 

J = 

k22{eT,2 — y2) 

0 

-kl2 - k22X 0 


0 


^2n(cT,n Dn) 

0 

0 

0 

kin k2nX 


and all the properties in Prop. |2] hold with S- = {1} and S'o = {2, 3,..., n}. Thus, this system is SOST 
on O w.r.t. the Li norm. 

Arguing as in the proof of Proposition [2] for the matrix measure p^o indueed by the L^o norm (see dV])) 
yields the following result. 
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Proposition 3 Consider the Jacobian J(-) : —)■ of the time-invariant system (fTSl) . Suppose that 

is compact and that the set {1,... ,n} can be divided into two non-empty disjoint sets Sq and such 
that the following properties hold for all x G 

1) dj{J{x)) < 0 for all j G Sq; 

2) dk{J{x)) < 0 for all k G S_; 

3) for any j G S'o there exists an index z = z{j) E S- such that Jjz{x) 7 ^ 0. 

Then (fTSl) is SOST on w.r.t. the Loo norm. 

B. contractive after a small overshoot 

A natural question is under what eonditions SO and SOST are equivalent. To address this issue, we 
introduee the following definition. 

Definition 3 We say that ([B is weakly expansive (WE) if for each 5 > 0 there exists tq > 0 such that 
for all a,b E Ll and all to > 0 

\x{t,to,a) - x{t,to,b)\ < {1 + 6)\a — b\, for all t E [to,to 3 -tq]. (22) 

Proposition 4 Suppose that ([T]) is WE. Then ([T]) is SOST if and only if it is SO. 

Remark 1 Suppose that f in ([B is Lipschitz globally in O uniformly in t, i.e. there exists L > 0 such 
that 

- f{t,y)\ < L\x - y\, for all x,y eVL, t > 0. 

Then by GronwalTs Lemma (see, e.g. /I35l Appendix C]) 

\x(t, to, a) — x(t, to, 6)1 < exp (L(t — to)) |a — 6 |, 

for all t>to>t), and this implies that (l22l) holds for tq := ln(l + 5) > 0. In particular, iffl is compact 
and f is periodic in t then WE holds under rather weak continuity arguments on f. 

C. contractive after a short transient 

For time-invariant systems whose state evolves on a eonvex and eompaet set it is possible to give a 
simple suffieient eondition for ST. Let Int(S') [95] denote the interior [boundary] of a set S. We require 
the following definitions. 

Definition 4 We say that ([B L non expansive (NE) w.r.t. a norm \ ■ \ if for all a,b eVL and all S 2 > si > 0 

|x(s 2 , Si, 0 ) - x(s 2 . Si, 6)1 < |a - 6|. (23) 

We say that O is weakly eontraetive (WC) if (|23]) holds with < replaced by <. 

Definition 5 The time-invariant system ([T8]) with the state x evolving on a compact and convex set O C 
R"^, is said to be interior eontraetive (IC) w.r.t. a norm | ■ | : R"^ —)■ R+ if the following properties hold: 

(a) for every xo E dkl, 

x(t,xo) ^ dVt, for all 6 > 0; (24) 

(b) for every x E Int(f2), 

/r(J(a;))<0, (25) 

where /r : —)■ R A the matrix measure induced by | ■ |. 

In other words, the matrix measure is negative in the interior of Ll, and the boundary of Lt is “repelling”. 
Note that these eonditions do not neeessarily imply that the system satisfies Q on Ll, as it is possible 
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that fi{J{x)) = 0 for some x G Yet, (l25l) does imply that (flSl) is NE on We ean now state the 
main result in this subseetion. 


Theorem 2 If the system (fTSl) is IC w.r.t. a norm \ ■ \ then it is ST w.r.t. 


The proof of this result is based on showing that IC implies that for eaeh r > 0 there exists d = dij) > 0 
such that 


dist(a;(f, Xq), > d, for all xq G and all f > r, 


and then using this to conclude that for any f > r all the trajectories of the system are contained in a convex 
and compact set D C Int(f2). In this set the system is contractive with rate c := max^jg^)/r(J(a;)) < 0. 
The next example, that is a variation of a system studied in [|3l|, demonstrates this reasoning. 


Example 6 Consider a transcriptional factor X that regulates a downstream transcriptional module by 
irreversibly binding, at a rate k 2 > 0, to a promoter E yielding a protein-promoter complex Y. The 
promoter is not subject to decay, so its total concentration, denoted by ct > 0, is conserved. Assume 
also that X is obtained from an inactive form Xq, for example through a phosphorylation reaction that 
is catalyzed by a kinase with abundance u{t) satisfying u{t) > uq > 0 for all t > 0. The sum of the 
concentrations of Xq, X, and Y is constant, denoted by zt, with zt > ct- Letting xi{t),X 2 it) denote the 
concentrations of X, Y at time t yields the model 


Xi ={zt - Xi- X2)u - 5xi - k2{eT - X2)xi, 

±2 =k2{eT - X2)xi, (26) 


with the state evolving on Q := [0, zt] x [0, ct]- Here 6 > 0 is the dephosphorylation rate X —>■ Xq. 
Let P := Q I , and consider the matrix measure Poo,p- ^ calculation yields 


J := PJP-^ 

_ —u — 5 6 

k2(eT - X 2 ) k2(x2 - xi - Ct) ’ 

so di(J) = —u — 5 + |(i| < —Uq < 0, and 

d2{J) = k2{x2 -Xi- Ct) + \k2{eT - X2)\ 
= -k2Xi. 


Letting S := {0} x [0, Ct], we conclude that Poo,p{.x) < 0 for all x E {fl\ S). For any x E S, 
xi = {zt — X 2 )u > {zt — eT)uo > 0, and arguing as in the proof of Theorem |2] (see Section 0, we 
conclude that for any r > 0 there exists d = d{T) > 0 such that 

Xi{t, a) > d, for all a E Q and all t > r. 

In other words, after time r all the trajectories are contained in the closed and convex set D = D{t) : = 
[d, Zt] X [0, Ct]. Letting c := c(r) = max^-g/) Poo,p{J{x)) yields c < 0 and 

\x(t + r, a) — x(t + r, 6)|oo,p < exp(cf)|a — b\oo,p, for all a,b E fl and all t > 0, 
so (l26l) is ST w.r.t. \ ■ \oo,p- 

As noted above, the introduction of GCSs is motivated by the idea that contraction is used to prove 
asymptotic results, so allowing initial transients should increase the class of systems that can be analyzed 
while still allowing to prove asymptotic results. The next result demonstrates this. 


9 







Fig. 1. Solution xi{t) (solid line) and X 2 {t) (dashed line) of the system in Example |7] as a function of t. 


Corollary 2 If (fTSl) is IC with respect to some norm then it admits a unique equilibrium point e G Int(f2), 
and limi_).oo x{t, a) = e for all a E fl. 

Remark 2 The proof of Corollary \2i given in the Appendix, is based on Theorem |2] Consider the 
variational system (see, e.g., /f72l/ ) associated with (fTSl) ; 

X = /(x), 

5x = J(x)5x. (27) 

An alternative proof of Corollary^ is possible, using the Lyapunov-Finsler function V(x,6x) := |5x|, 
where | ■ | : —)■ M+ is the vector norm corresponding to the matrix measure p in (1251) . and the LaSalle 
invariance principle described in / f72l/ . 

Since IC implies ST and this implies SOST, it follows from Proposition [T] that IC implies entrainment 
to T-periodic vector fields Q The next example demonstrates this. 

Example 7 Consider again the system in Example ^ and assume that the kinase abundance u(t) is a 
strictly positive and periodic function of time with period T. Since we already showed that this system 
is ST, it admits a unique periodic solution 7 , of period T, and any trajectory of the system converges 
to 7 . Figure [7] depicts the solution of (l26l) for 5 = 2, k 2 = 1, zt = 4 ct = 3, u(t) = 2 + sin(27rf), and 
initial condition Xi(0) = 2 ,X 2 ( 0 ) = 1/4. It may be seen that both state-variables converge to a periodic 
solution with period T = 1. (In particular, X 2 converges to the constant function X 2 (t) = ct that is of 
course periodic with period T.) 

Contraction can be characterized using a Lyapunov-Finsler function [fT^ . The next result describes a 
similar characterization for ST. For simplicity, we state this for the time-invariant system (fTSl) . 

Proposition 5 The following two conditions are equivalent. 

(a) The time-invariant system (fTSl) is ST w.r.t. a norm | ■ |. 

'Note that the proof that IC implies ST used a result for time-invariant systems, hut an analogous argument holds for the time-varying 
case as well. 
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(b) For any r > 0 there exists i = £{t) >0 such that for any a,b ^ fl and any c on the line connecting a 
and b the solution of (1271) with a;(0) = c and (5a;(0) = b — a satisfies 

\5x{t + r)| < exp(—£t)|5a;(0)|, for all t > 0. (28) 

Note that (1281) implies that the funetion V{x, 6x) := |(5a;| is a generalized Lyapunov-Finsler funetion in 
the following sense. For any r > 0 there exists i = £{t) >0 sueh that along solutions of the variational 
system: 

V {x{t + T, x(0)), 6x{t + r, (5x(0), a;(0))) < exp(—ff)l/(a:(0), fe(0)), for all f > 0. 

In the next section, we describe several more related notions and explore the relations between them. 


IV. Additional Notions and Relations 

It is straightforward to show that each of the three generalizations of contraction in Definition [T] implies 
that dU) is NE. One may perhaps expect that any of the three generalizations of contraction in Definition [T] 
also implies WC. Indeed, ST does imply WC, because 

|a;(s2, si, a) - x(s2, Si, b)\ < exp {-£{s 2 - Si)/ 2 ) \a - b\ < \a-b\, 

for all 0 < Si < S2 if ST holds (simply apply the definition with ti = si, r = (s2 — si)/2 > 0 , 
and ^2 = Si + T in (fT0l) f. However, the next example shows that SO does not imply WC. 


Example 8 Consider the scalar system 


X = 


■n 

1 

to 

0 < \x\ 

1 N’ 

1 < |x| 


(29) 


with X evolving on O := [—1,1]. Clearly, this system is not WC. However, it is not difficult to show that 
it satisfies the definition of SO with i = i{e) := min{ln(l + e), 1} . 


The next result presents two conditions that are equivalent to SOST. 


Lemma 1 The following conditions are equivalent. 

1) System ([T]) is SOST on O w.r.t. some vector norm | ■ |^ : —)■ M+. 

2) For each r > 0 there exists i = ('(r) > 0 such that 

\x{t 2 + r, fi, a) - x(t 2 + r, fi, bffi < (1 + r) exp(-(f 2 - ti)£)\a - 6|^, (30) 

for all t 2 >ti>D and all a,b & Q. 

3) For each £ > 0 and each r > 0 there exists £\ = ^i(r, e) > 0 such that 

\x{t,ti, a) - x{t,ti, bffi < (1 + e) exp(-(f - ti)ii)\a - 6|^, (31) 

for all t > ti + T > T and all a,b ^ Q. 

Fig. |2] summarizes the relations between the various contraction notions. 


V. Proofs 

Proof of TheoremUl Fix arbitrary £ > 0 and F > 0. The function ( = ({r) G (0,1/2] is as in the statement 
of the Theorem. For each r > 0, let > 0 be a contraction constant on where we write ( = ({r) 
here and in what follows. Pick a, 6 G O and r > 0. By (fTSI) . x{t, ti, a),x{t, ti,b) G for all f + r, 
so 

\x{t, ti, a) — x{t, ti, 6 )|(^ < exp(—c^(f — — r))|x(ti + r, ti, a) — x{ti + r, fi, 6 )|^, for all t >ti + t. 

(32) 
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Fig. 2. Relations between various contraction notions. An arrow denotes implication; a crossed out arrow denotes that the implication is 
in general false; and a dashed arrow denotes an implication that holds under an additional condition. Some of the relations are immediate. 
Others follow from the results marked near the arrows. 


In particular, 

|x(t, ti, a) — x{t, ti, b)\(^ < \x{ti + r, ti, a) — x{ti + r, ti, 6 )|^, for all t > ti + r. (33) 

From the convergence property of norms in the Theorem statement, there exist > 0 such that 

bl <-Fcblc ^forallf/efl, (34) 

and ^ 1, ^ 1 as r —)■ 0. Combining this with (l3^ yields 

\x{t, ti, a) — x{t, ti, 6)1 < V;^w^\x{ti + T, ti, a) — x{ti + r, ti, b)\, for all t > ti + r. 

Note that taking r —)■ 0 yields 

|a;(f, fi, a) — x(f, ti, 6)1 < |a — 6 |, for all 6 > 6 i. (35) 

Now for t > ti + T let p := t — ti — T. Then 

\x{t, ti, a) — x{t, ti, 6)1 < V:^\x{t, ti, a) — x{t, ti, 6 )|^ 

< V(;exp{-c^p)\x{ti + r,6i,a) - x{ti + r,fi,6)|f 

< v^W(^ exp(-c^p) |a;( 6 i + r, fi, a) - x{ti + r, fi, 6 ) | 

< r;^tc^exp(—C(;'p)|a — 6|, 

where the last inequality follows from (1351) . Since —)■ 1, —)■ 1 as r —)■ 0, < 1 + e for r > 0 

small enough. Summarizing, there exists Tm = Tm{£) > 0 such that for all r G [0, Tm] 

\x{t + r, fi, a) — x{t + r, fi, 6 )| < (1 + e) exp(—c^(f — fi))|a — 6 |, (36) 

for all a,b and all t>ti. Now pick r > Tm- For any f > fi, let s := f + r — Tm- Then 

\x{t + r,fi,a) - x{t + T,ti,b) \ = |a;(s + Tm,ti,a) - x{s + Tm,ti,b)\ 

< (1 + e) exp(-c^(s - fi))|a - 6 | 

< (1 + e) exp(-c^(f - fi))|a - 6 |, 

and this completes the proof. ■ 
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Analysis of the system from Example\^ The Jacobian of (fT4l) is 

0 0 ... 0 g'{xn)' 


J{x) = 


~(y.\ 

1 

0 


-02 0 
1 -as 


0 

0 


0 0 


so 


D,J{x)D;' = 


— (y.\ 

(y.\ — E 
0 


0 

- 0.2 


0 

0 


02 — S 0 


0 0 


0 

0 

~Oir. 


0 

0 

0 

(y.n—\ E 


0 

0 


Oir 


Thus, 


= max{-£, 9'(^a) nfai‘(a. ■?) 


n”.-i‘(a< - ■:) 


Suppose that k — 1 < ak"^. Then for all x G 




(37) 


(38) 


, k — 1 k — 1 

»(^”) = (FF^ ^ 

Combining this with (1381) implies that there exists a sufficiently small e > 0 such that pi,De{J{x)) < —e/2 
for all X G so the system is contractive on M” w.r.t. | ■ |i,_De- 
Now assume that k — 1 = ak"^. By (l37l) . 

det(J(a:)) = (-l)”(a - g'{xn)), 


so for every x G with Xn = 0, we have det(J(a;)) = (—l)'^(a — 5''(0)) = 0. This implies that the 
system does not satisfy dH), w.r.t. any norm, on M”. 

We now use Theorem [l] to prove that (fT4l) is SOST. Since g'{u) = and k > 1, 

g{xn) > 5'(0) = 1/fc, for all x G M”. 


For C G (0,1/2], let 


(1^ := {x G : x > C}. 


It is straightforward to verify that (fT4l) satisfies condition (BR) in ll22l Lemma 1], and this implies that 
for every r > 0 there exists e(r) > 0 such thut x{ij^ ^ for 3 .II f ^ t. Then 


g'M 


k — 1 k — 1 k — 1 
{k + XnY ~ {k-\-eY ^ kP' 


We already showed that this implies that there exists a C > 0 and a norm | ■ |i £)^ such that (fT4l) is 
contractive on w.r.t. this norm. Summarizing, all the conditions in Theorem [T] hold, and we conclude 
that (fT4l) is SOST on M” w.r.t. | ■ |i^Fo- ■ 

Analysis of the system in Examplel^ For a G O, let x{t, ti, a) denote the solution of (fTTl) at time t > ti 
for the initial condition x{ti) = a. Pick r > 0. Eq. (fTTl) satisfies condition (BR) in [|2^ Lemma 1], and 
this implies that there exists £ = £(r) > 0 such that for all a G O, alH = 1,. .. n, and all f + r 


Xi(t, ti,a) > e. 


13 














Furthermore, if we define yi{t) := Pn-i+i — Xn-i+iit), i = then the y system also satisfies 

condition (BR) in [|22l Lemma 1], and this implies that there exists ei = £i(r) > 0 such that for 

all a E Q, all i = 1,.. .n, and all f > fi + r 

yi(ti tl, Cl') ^ El- 

We conclude that after an arbitrarily short time r > 0 every state-variable Xi{t), t > r + ti, is separated 
from 0 and from pi. This means the following. For E [0,1/2], let 

:= {x e : (pi <Xi<{l- C)pi, i = l,...,n}. 

Note that flo = and that is a strict subcube of for all ( E (0,1/2]. Then for any ti > 0, and 
any r > 0 there exists C = C(''') ^ ( 0 , 1 / 2 ), with ({r) —)■ 0 as r —)■ 0 , such that 

x{t, ti,a) E for all f + r and all a E Q. (39) 

The Jacobian of (fT71) satisfies J(f, x) = L{x) — diag(c(f), 0,..., 0, rjn), where 

0 0 
0 
0 

0 • • • 'Cjn—2CCn—2 Vn—l{Pn ^^n) Cjn—lCCn—1 

0 ... Vn-l{Pn-Xn) -r]n-lXn-l. 

Note that L{x) is Metzler, tridiagonal, and has zero sum columns for all x E fl. Note also that for 
any x G every entry on the sub- and super-diagonal of L satisfies < Lij < (1 — 0^2, 
with S 2 := maXi{piPi} > Si ;= mmi{piPi} > 0 . 

Note also that there exist x E dVt such that J(x) is singular (e.g., when xi = 0 and X 3 = ps the second 
column of J is all zeros), and this implies that the system does not satisfy dH) on w.r.t. any norm. 

By [|^ Theorem 4], for any C, E (0,1/2] there exists e = > 0, and a diagonal matrix D = 

diag(l, gi, qiq 2 ,..., qiq 2 ■ ■ ■ qn-i), with g* = qi{£) > 0, such that (fT71) is contractive on w.r.t. the the 
scaled Li norm defined by |z|i,d = \Dz\i. Furthermore, we can choose £ such that £((/) —)■ 0 as ^ ^ 0, 
and i9(e:) —)■ / as £ —)■ 0. Summarizing, all the conditions in Definition [2] hold, so (fTVl) is NC on D and 
applying Theorem [T] concludes the analysis. ■ 

Proof of Proposition [21 Without loss of generality, assume that Sq = {1,... ,k}, with 1 < k < n — 1, so 
that S'. = {/c -I- 1,... ,n}. Fix e E (0,1). Let D = diag(di,..., d^) with the djS defined as follows. For 
every i E Sq, di = 1 and dz{i) = I — £. All the other djS are one. Let J := DJD~^. Then Jij = We 

now calculate pi(J). Fix j E Sq. Then dj = 1, so 

~ jjj + \Jij\ 

\<i<n 

'^33 ^ I I ^ ^ 

iGSo k£S— 

i¥=j k^j 

~ 3” ^ ^ ^ ^ dk\Jkj\ 

iGSq k£S— 

^¥=3 k^j 

where the inequality follows from the fact that < 1 for all k, and for the specific value k = z{j) E S_ 
we have dk = I — £ and \Jkj\ > 0. We conclude that for every j E Sq, Cj{J) < Cj{J) = 0. It follows 


L(x) = 


-Pl{p2 - X 2 ) 
Vl{P2 - X 2 ) 
0 


PlXi 

-771X1 - 772 (P 3 -X3) 
V2{P3 - X 3 ) 
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from property [2l) in the statement of Proposition [2] and the compactness of that there exists 5 > 0 such 
that Cj{J{x)) < —5 for all j G S', and all a; G so for e > 0 sufficiently small we have Cj{J{x)) < 
—5/2 for all j G S', and all x E Vt. We conclude that for all £ > 0 sufficiently small, ixi{DJD~^) = 
maxj Cj{J) < 0, i.e. the system is contractive w.r.t. | ■ Clearly, | ■ |i^£) —| ■ |i as £ —)■ 0, and applying 
Corollary [T] completes the proof. ■ 

Proof of Proposition Suppose that © is SOST w.r.t. some norm | ■ |^. Pick £ > 0. Since the system 
is WE, there exists tq = To(e:) > 0 such that 

\x(t,to,a) -x(t,to,b)\y < (1 + e:/2)|a - 

for all f G [to,to + To]. Letting 4 

\x(t, to, a) - x(t, to, b) 1^ < (1 + e) exp(-(f - fo)4) |a - (40) 

for all t G [to, to + To]. By item [3] in Lemma [U there exists ii = £i{To,e) > 0 such that 

\x{t,to,a) - x{t,to,b)\.^ < (l + e)exp(-(f-fo)4)|a-&U 

for all t > to + To- Combining this with (l40l) yields 

\x{t,to,a) - x{t,to,b)\^ < (1 + e)exp{-{t - to)i)\a - b\y, 

for all t > to, where i := minj^i , £ 2 } > 0 . This proves SO. ■ 

Proof of Theorem [21 We require the following result. 

Lemma 2 If system (ITSl) is IC then for each r > 0 there exists d = d^r) >0 such that 

dist(a;(f, Xq), dfl) > d, for all Xq G O and all t > t. 

Proof of Lemma m Pick r > 0 and Xq G fl. Since fl is an invariant set, Int(O) is also an invariant 
set (see, e.g., [l3^ Lemma III. 6 ]), so (l24l) implies that x{t,xo) ^ dfl for all f > 0. Since dfl is compact, 
e 3 ;p := dist(x(r, Xo), 90) > 0. Thus, there exists a neighborhood of Xq, such that dist(x(r, y), 90) > 
6 x 0/2 for all y G Uxo- Cover O by such Uxo sets. By compactness of O, we can pick a finite subcover. Pick 
smallest e in this subcover, and denote this by d. Then d > 0 and we have that dist(x(r, xq), 90) > d 
for all Xq G O. Now, pick t > t. Let xi := x{t — t, Xq). Then 

dist(x(f, xo), 90) = dist(x(r, xi), 90) 

> d, 

and this completes the proof of Lemma [U ■ 

We can now prove Theorem [2l We recall some definitions from the theory of convex sets. Let B{x,r) 
denote the closed ball of radius r around x (in the Euclidean norm). Let ff be a compact and convex set 
with 0 G Int(iC). Let s{K) denote the inradius of k, i.e. the radius of the largest ball contained in K. 
Lor A G [0, s(iC)] the inner parallel set of K at distance A is 

K_x := {x G iC : B{x,X) C K}. 

Note that K^x is a compact and convex set; in fact, K^x is the intersection of all the translated support 
hyperplanes of K, with each hyperplane translated “inwards” through a distance A (see [[371 Section 17]). 
Assume, without loss of generality, that 0 G Int(f2). Pick r > 0. Let M = M{t) := {x{t, Xq) : f > r, Xq G 
O}. By Lemma [2l M C fl and dist(?/,9f2) > d > 0 for all y G M. Let A = A(r) := | min{d, s(f2)}. 
Then A > 0. Pick z e M. We claim that B{z, A) C £1. To show this, assume that there exists v G B{z, A) 
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such that V ^VL. Then there is a point q on the line connecting v and 2 ; such that q G dVL. Therefore, 

dist( 2 ;, < 1 ^ — g| 

<\z — v\ 

< A 

<d/2, 

and this is a contradiction as z e M. We conclude that M C K_x. Let c = c(r) := max^eK.x 
Then (|251) implies that c ^ 0. Thus, the system is contractive on K _and for all n, 6 G and all f ^ 0 

\x(t + T,a) — x(t + T,b)\ < exp(ct)|a — b\, 

where | ■ | is the vector norm corresponding to the matrix measure /x. This establishes ST, and thus 
completes the proof of Theorem [2l ■ 

Proof of Corollaryl^ Since fl is convex, compact, and invariant, it includes an equilibrium point e of (fTSl) . 
Clearly, e G lnt(f2). By Theorem [2l the system is ST. Pick a E Q and r > 0, and let i = f(r) > 0. 
Applying (fT^ with b = e yields 

\x{t + r, a) — e| < exp{—£t)\a — e|, 

for all t > 0. Taking f —)■ cxo completes the proof. ■ 

Remark 3 Another possible proof of Corollary^ is based on defining C : —)■ M+ by V{x) := \x — e\. 
Then for any a Efl, V{x{t, a)) is nondecreasing, and the LaSalle invariance principle tells us that x{t, a) 
converges to an invariant subset of the set {y E fl \y — e\ = r}, for some r > 0 . T/’r = 0 then we are 
done. Otherwise, pick y in the omega limit set of the trajectory. Then y ^ dfl, so (1251) implies that V is 
strictly decreasing. This contradiction completes the proof. 

Proof of Proposition 121 Pick a,b E fl. Let 7 : [0,1] —?• be the line 7 (r) := (1 — r)a + rb. Note that 

since fl is convex, 7 (r) G fl for all r G [0,1]. Let 

w{t,r) := ■^x{t,'j{r)). 

This measures the sensitivity of the solution at time t to a change in the initial condition along the line 7 . 
Note that t(;(0, r) = ^ 7 (r) = b — a, and 

w(t,r) = J{x(t,'y{r)))w(t,r). 

Comparing this to (1271) implies that w{t,r) is equal to the second component, 5x{t), of the solution of 
the variational system (l27l) with initial condition 

a;(0) = (1 — r)a + r 6 , (41) 

()a;( 0 ) = b — a. 

Suppose that the time-invariant system (fTSl) is ST. Pick r > 0. Let i = £(r) > 0. Then for any r E [0,1) 
and any £ G [0,1 — r], 

\x{t + r, 7 (r -f £)) - x(t + r, 7 (r))| < exp(-ff)| 7 (r -f e) - 7 (r)|. 

Dividing both sides of this inequality by e and taking £ 0 implies that 

\w{t + T,r)\ < exp{—ti)\b — a\, (42) 


so 

\6x{t + r)| < exp(—ff)|fe(0)|. 
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This proves the implieation ([aD —> ©. To prove the eonverse implieation, assume that (1281) holds. Then (|4^ 
holds and thus 


\x{t + r, 6) — x{t + r, a) I = 


"1 d 

—a;(t + r, 7 (r))dr 

\ CLT 


< / + r, r)| dr 


< / exp(—£t)|6 — a|dr 


= exp{—it)\b — a\, 


so the system is ST. ■ 

Proof of LemmaUl If © is SOST then (l30l) holds for the partieular case e = t in Definition [U To prove 
the converse implication, assume that (l30l) holds. Pick > 0. Let 

r:=min{f,£}, (43) 

and let I = £(r) > 0. Pick f > 0, and let ^2 := ^ + — t > ti. Then 

\x{t 2 + T, fi,a) - x{t 2 + T,ti,b)\y < (1 + r) exp(-(f2 - ti)i)\a - b\y 

< (1 + e) exp(-(f - ti)i)\a - b\y, 

where the last inequality follows from (l43l) . Thus, 

\x{t + f,ti, a) - x{t + f,ti, b)\y < (1 + e) exp(-(f - ti)£)\a - b\y, 

and recalling that f,i > 0 were arbitrary, we conclude that Condition 2) in Lemma [T] implies SOST. 

To prove that Condition 3) is equivalent to SOST, suppose that (|3TI) holds. Then for any t 2 > ti. 


\x{t2 + T,ti,a) - x(t2 + T,ti, b) < (1 + e) exp(-(t 2 + r - ti)fi)\a - b\^ 

< (1 + £) exp(-(t2 - fi)^i)|a - 

so we have SOST. Conversely, suppose that © is SOST. Pick any r, e > 0. Then there exists £ = 
£{t, e/2) > 0 such that for any f > ti + r 


\x{t, fi, a) 

Thus, for any c G (0,1) 


x{t,ti, b)\y = \x{t - r + T,ti, a) - x{t - T + T,ti, b)\y 
< (1 + e/2) exp(-(f - r - ti)£)\a - b\y. 


\x(t, ti, a) — x(t, ti, 6)1^ < (1 + e/2) exp(rc(') exp(—(f — ti)c£)\a — b\y. 

Taking c > 0 sufficiently small such that (1 + e/2) exp(rc£) < 1 + e implies that (l3TI) holds for £i := c£. 
This completes the proof that (l3TI) is equivalent to SOST. ■ 
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